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ABSTRACT 

Data from a sample of adult participants in JTP Ohio 
under Title IIA of the Job Training Partnership Act (JTPA) were 
analyzed. Respondents were surveye^l after completion of 13 weeks of 
JTP training. Five outcome variables were studied: weeks worked, 
employment status during week 13, earnings in week 13, welfare status 
during week 13, and school attendance status. Demographics, reason 
for termination from JTP, and service delivery area effects were also 
analyzed. Among the findings were the following: (1) preexisting 
differences had a significant influence on the outcomes — females, 
blacks, and older workers earned le&s and JTP services had the 
intended effects of increasing likelihood of employment and number of 
weeks worked and decreasing likelihood of being on welfare; (2) these 
differences were found even though indicators such as education, 
training, and labor market experience were controlled statistically; 
(3) classroom training, job search assistance, and on-the-job 
training increased the likelihood of employment in week 13 and the 
number of weeks worked thereafter and decreased the likelihood of 
receiving public assistance. It was concluded that JTP Ohio services 
hsive the intended effects on labor market outcomes. Reason for 
termination from JTP programs is a critical factor. (Twenty-two data 
tables and seven references are appended.) (YLB) 
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FOREWORD 



In 1986, the United States Department of Labor (DOL) mandated 
that the economic status of Job Training Partnership Act (JTPA) 
clients be determined 13 weeks after completion of a Job Training 
Partnership (JTP) program. Prior to this mandate, relatively 
little Information was available to DOL as to the long-term 
effects of participating In a JTP program. To administer the 
resources provided by JTPA successfully, DOL must have Information 
on whether or not the programs that were Implemented are meeting 
the needs of its clients. This first annual report addresses that 
need for information. 

The study was conducted in the Evaluation and Policy division 
of the National Center under the direction of N.L. McCaslin, 
Associate Director. Dr. Lawrence Hotchkiss, Research Specialist, 
served as project director. We would like to thank Program 
Associate John Smythe and Dr. Dennis Benson, President of 
Appropriate Solutions, Inc., for their work in preparing this 
report. Special thanks are extended to Alice Worrell, Manager of 
Ev luatlon Services, Ohio Bureau of Employment Services, for her 
cooperation and patience as well as the helpful insights she 
provided. 

We wish to thank Rodney Ferryman for the extensive computer 
programming that made the analysis possible. Special thanks go to 
Nary J. Zuber who produced the typed manuscript and Incorporated 
the many revisions. 



Ray D. Ryan 
Executive Director 
The National Center for Research 
in Vocational Education 



EXECUTIVE SUMMARY 



This report presents an evaluation of JTP Ohio services to 
adult clients who participated under title IIA of the Joint 
Training Partnership Act. Data from a follow-up survey of JTP 
clients conducted 13 weeks after completion of JTP training were 
combined with data from the state Management Information Systems 
(MIS) system. Multivariate methods were applied to evaluate JTP 
Ohio services and to analyze difference In outcomes among service 
delivery areas (SDAs) • 

These analyses were designed to determine If clients bene* 
fitted from the services they received from JTP Ohio In terms of 
the following outcomes: 

o Weeks worked during the 13-week period after program 
termination 

o Employment status In week 13 

o Earnings In week 13 of those who were employed 

o Welfare status In week 13 

o School attendance during week 13 

To provide accurate estimates of the effects of JTP Ohio 
services, the analysis of these outcomes controlled for differ- 
ences among the clients that existed when they applied for the 
program. The preexisting differences had significant Influence on 
the outcomes evaluated by the 13-week follow-up. 

o Females earned less than males. 

o Blacks earned less and were more likely to be wel- 
fare recipients than whites and other minorities. 

o Older workers (those 55 and older) earned less than 
younger workers. 

These difference)} were found even though several Indicators 
of human capital (education, training, and labor market experi- 
ence) were controlled statistically. The results suggest that 
race, gender, and age discrimination operate in the labor market 
faced by JTP Ohio participants. 

Despite the strong influence of the individual characteris- 
tics of clients, JTP services had the intended effects. Classroom 
training, job search assistance, and on-the-job training (OJT) 
increased the likelihood that former clients were employed in week 
13 and Increased the number of weeks worked during the follow-up 



EMC 



ix 



period. These services also reduced the likelihood that former 
clients received public assistance during week 13. Former clients 
who took part in classroom training and OJT also had higher earn- 
ings, but clients who received job search assistance without 
skill training did not. 

All outcomes examined during the 13 week follow-up were 
influenced by those completers who entered employment upon 
termination of the program. Clients who were employed at 
termination worked more weeks, earned more, and were less likely 
to receive welfare support than clients who left the program for 
other reasons. Nevertheless, even when the effects of employment 
at termination are controlled, classroom training and OJT still 
influence overall employment during the follow-up period. The 
effect of job search assistance, however, was determined primarily 
by whether the job search was successful. 

The encouraging aspect of these findings is that factors 
directly under control of public policy and administration do 
influence economic and social outcomes. Classroom training 
appears to be a particularly useful tool because it tends to serve 
those with a lower socioeconomic profile than does OJT. It 
appears that clients who are judged to be less job ready are 
assigned to classroom training, those who are considered more job 
ready assigned to OJT, and both groups benefit from the services 
they receive. 

A potentially useful quantitative model to assist in evalu- 
ating SDA performance is sketched in this report. The basic idea 
is to observe the deviation of the adjusted mean on each outcome 
for each SDA from the statewide average. The adjusted means 
compensate for differences among SDAs in the socioeconomic compo- 
sition of the clients they serve. It is possible that statistical 
tests of whether these adjusted means differ from the state means 
could be used in the evaluations. For example, incentive grants 
could be provided to SDAs who perform above a predetermined stan- 
dard to a statistically significant degree. 

The present evidence does not support the view that effec- 
tiveness of JTP services varies among SDAs, but tests for the 
possibility of r^^ch variations should still be included in future 
research and evaluation. An additive regression analysis implies 
that any differences among SDAs on the outcome variables are due 
solely to the quantity of services provided. A model including 
SDA X services interactions is proposed as a way to evaluate 
quality differences in services among SDAs. 

An important aspect of the analysis conducted here is that no 
one is included in the sample who had not participated in JTP in 
some fashion. Lack of a comparison group makes it impossible to 
assess the overall effects of participation. Absence of a com- 
parison group also means that SDA evaluations necessarily depend 
on comparisons among JTP clients in different SDAs. A type of 
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"^grading mi the curve** therefore is implied. With a comparison 
group it would at least be feasible to attempt to establish evalu- 
ation criteria based on the extent to which JTP clients fare 
better thtn nonclients rather than criteria based solely on 
whether clients in one SDA do better than clients in other SDAs. 
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INTRODUCTION 



The Ohio Buronu of Employment Services (OBES) administers 
many training programs under the auspices of the Job Training 
Partnership Act ( JTPA) • This report Is part of a sequence of 
reports designed to provide OBES with detailed data that can be 
used to help evaluate these training programs. One of these 
reports has already been submitted to OBES, and It Is entitled 
Ohio Thlrteen-Week F qIIowUp Survey of Title IIA and Title III JTP 
Clients . This report provides OBES with the data required to 
complete the Department of Labor's JTPA Annual Status Report 
(JASR) • The present report contains the statewide analysis of JTP 
Ohio title IIA clients. In addition, reports containing detailed 
data by SDA for title IIA clients, a statewide summary for tltla 
III clients, and a report on employers of JTP Ohio title IIA 
clients are Included In the sequence. 

Data for these reports are taken from three sources. The 
primary data source Is a follow-up survey of Individuals who 
received training under JTP Ohio training programs. A large 
sample (N « 4012 completions) of Individuals receiving training 
under title IIA of the act and a small statewide sample (N - 251 
completions) of Individuals receiving training under title III of 
the act are Included In this survey. The second source of Infor- 
mation was a sample of employers of former JTP Ohio clients. This 
sample provides data for the employer report. The final source of 
Information comes from OBES's Management Information Systems 
(MIS) . The MIS files were merged with the survey data to produce 
the data summaries contained in these reports. The present report 
utilizes data from the client su-vey and the MIS files. 

This report is divided into four chapters. Chapter 2 
explains the methodology of the study. Chapter 3 reports the 
findings. The final chapter summarizes the findings and evaluates 
them. 
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CHAPTER 2 



METHODS 



SftBPlinq 

In dateralnlng ih« tltl* IIA sample for the state of Ohio, we 
followed In detail the procedures outlined In the Technical 
Assistance Guide (TAG) provided by the Department of Labor (U.S. 
Department of Labor 1986) . As prescribed by TAG, title IIA sample 
sizes were calculated for each SDA In a manner necessary to assure 
a preset level of precision with a 95 percent confidence level. 
In drawing these samples. If an SDA had fewer than 200 termlnees, 
then all termlnees in that SDA were Included in the sample. If, 
on the other hand, an SDA had more than 200 termlnees, then the 
procedures outlined in exhibit 3.11 of TAG were used to select the 
seunple size. 

Once the proper sample size was determined, it was then 
multiplied by a factor of 1.1 in order to obtain an oversample. 
There are two reasons for oversampling. First, by oversampling, 
we avoided sampling bias problems that can be caused by changing 
sampling proportions due to an SDA wrongly estimating the number 
of termln«es. Second, the oversample was used to provide a backup 
pool of cases fram which to draw replacements in the event those 
in the primary sample must be dropped due to disability or death. 

All statewide statistical summaries contained in this report 
wece calculated using sample weights. Sample weights were used to 
correct for unequal sampling probabilities for different SDAs, 
welfare status, .md for the difference in response rates between 
those employed and those not employed at termination. The weights 
are defined as the proportion of individuals in the population for 
each combination of SDA, welfare status, and employment status 
divided by the total proportion of completions in the sample. The 
sample weights yield precisely the same results within each SDA 
for the total sample and welfare recipients as did the adjustment 
for nonresponse bias displayed in TAG. 

Data Collection 

The first step in the data collection process was to attempt 
to complete each Interview by telephone. The telephone Interview 
followed in detail the DOL requirements as described in TAG. 
After 2 weeks, if the Interviewer was unable to Interview the 
termlnee successfully by phone, then a mail version of the ques- 
tionnaire was sent. Five days after the mall survey was sent, a 
combination thank-you and _ minder letter was mailed to the 
termlnee. If, after an additional 5 days, the survey was not 
returned, then a second mall survey was sent. If the second mail 
survey was not returned and the termlnee was still not success- 
fully Interviewed by telephone, then his or her file was classi- 
fied as Incomplete. 



1 Included in th« aailout* and in all tha talaphona maaaagaa 
laft for tha tarainaa waa tha 800 talaphona nuabar for tha ASI 
aurvay cantar. Thia numbar waa laft with inatructiona ancouraging 
tna taminaa to call in to complata tha intarviaw. Tha "call-In" 
Mthod of data acquiaition provad highly auccaasful and accounted 
f or iiora coaplatad intarviawa than aithar tha initial phona calla 
or tha Bail aurvay. 

Statiatical Ana^yMf 

Raaulta of tha atatiatical analyaaa ara raportad in bivariata 
and miltivariata tablaa. Fiva dapandant variablaa ara includad in 
tha analyaaa; thaaa ara (1) waaka workad during tha 13-waa)c 
follow-up pariod, (2) whathar aaployad during waak 13 of tha 
follow-up pariod, (3) aaminga during waak 13 for thoaa who 
workad, (4) whathar racaiving public aaaiatanca (walfara) during 
%iaak 13, and (5) whathar attandad achool during tha 13-waak 
follow-up pariod. Tabla antriaa ara avaragaa (or naana) for weeka 
workad and aaminga; antriaa ara parcantagaa for tha remaining 
variablaa. 



Ragraaaion analyaia waa applied to help isolate the net 
contributiona of aaveral variablaa to the five outcomea. Resulta 
of tha regreaaiona generally are preaanted in tabular format 
paralleling preaantation of tha bivariata relationahipa . In theae 
tablaa, antriea ara adjuatad naana or parcentagea on the dependent 
variablaa rather than obaarved valuaa. Differencea anong tha 
adjuatad antriea indicate the net impact of a given variable 
(e.g., race, gander, claaaroom training) while controlling for the 
remaining independent variablaa. 

The adjuatad antriea ara calculated to aatiafy two criteria: 
(1) Differencea between adjuatad maana or parcentagea ara conaia- 
tent with effect eatimatea in tha regreaaion analyaaa, and (2) the 
(weighted) average of the cell entriea equala tha overall avirage 
in tha aampla. (See, e.g., Cohen and Cohan 1983). Take aa an 
example, the adjuatad mean aaminga by gender (table 4) . The 
overall average aaminga irraapactive of gander ia $206.72. Tha 
regreaaion coefficient aaaociated with gender in the multiple 
regreaaion for aaminga ia 45.17. The adjuatad mean for malaa in 
tabla 4 ia $228.18; for famalaa it ia $183.00. The difference 
between the average for malaa and tha average for femalaa ia 
$228.18 - $183.00 - $45.18 which ia tha value of the regreaaion 
coefficient (diacrepancy due to rounding). There ara 2,747 
famalea and 2,887 malaa in tha aampla. The grand maan earnings in 
tha aampla ia tha average of the weighted means for fanalaa and 
malaa: (2747-$183 2887-$228. 18)/5634 - $206.15 (diacrepancy due 
to rounding) .1 



^Total aampla aizee were used in the adjustments rather than 
number of completera, or, in this case, number of employed 
completers. 
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The primary advantages of adjusted means or percentages over 
reporting regression coefficients Is that the adjusted values 
provide mere Information and permit ready comparison to the 
blvarlate tables. The primary disadvantages are that the adjusted 
values are not as parsimonious and are more cumbersome to calcu- 
late than the regression coefficients. 

Variables 

This section contains the definitions of all the variables 
used in the report. The follow-up data are taken from the survey 
described above. The other variables were defined from the Ohio 
Bureau of Employment Services MIS system. The source of data used 
to define each variable is indicated with the definition. 

o Age — The data are divided into 3 age groups these 
being (source — MIS) : 

— Ages 29 and younger 
—Ages 30-54 
--Ages 55+ 

o Gender — (Source — MIS ) : 

—Male (coded as 1.0 for regression analyses) 
—Female 

o Race — The data are divided into 3 racial 

categories these being (source— MIS) : 

—White 

— Bl:ick 

— Other — This group Includes Hlspanics, Asians, 
and Others. 

o Welfare status at follow-up — This variable indi- 
cates whether or not an individual received public 
assl^tcance at follow-up (source — survey): 

— yes 
—no 

o Education status at follow-up — This variable 

indicates whether or not an individual is enrolled 
in school at follow-up (source — survey, g. 4): 

— yes 
—no 

o Types of services — This variable specifies the 
types of services the JTP client received. We 
have chosen to use the three most common types of 
services (source — MIS transaction records) : 
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—On the job tre.ining/no on the job training 

—Job ■•arch/No job aaarch 

— Claaaroon taaching/No claasrooa teaching 

Raaaon for ending training— Thia variable apeci- 
fiea why a jtp client left a JTP training program. 
These variables contain five categories; these are 
(aource — MIS) : 

— Entered eaployment A01-A05 
--Exceeded program duration C12 
—Exceeded 90 day hold atatua C14 
—Poor attendance C06,C07 
—Other 

Education statue at Temination — This variable 
specifies the highest level of education the JTP 
client attained (aource — MIS) : 

— High achool dropout — Grades < 12 
— High school graduate — Grade 12 
— So«e college— Grade 13,14,15 
— 16+ — College graduate 

Barriers ta employnent— Three variables are used 
here to describe the nost coiunon barriers to 
employnent a JTP client might possess (source — 
MIS) : 

— Offender (yes/no) 

— Handicapped (yes/no) 

— Limited English (yes/no) 

Family status — This variable specifies the posi- 
tion of the individual within his/her household 
(source — MIS) : 

— Single parent with > one child under 6 years old 

—Single parent with > one child 6-17 years old 

— Paren": m two parent home 

—Other family member 

— Unr«%lated individual 

—Other 

Public assistance at application — This variable 
apecifiea whether or not a respondent received 
public aaaistance at the time of application to 
participate in JTP programs (source— MIS) : 



--no 

Nttlfartt status at application — If a JTP client 
rscslvas welfare this variable specifies the 
different types of welfare the client may receive 
(source — MIS) : 

— APOC 
—General 

— ^Not receiving public assistance 
Employment at week 13 (source — survey) : 

—Yes 

—No 

Earnings in week 13 in dollars (set to missing if not 
employed; source— survey) : 

Weeks worked during the 13-week follow-up (source — 
survey) : 

Welfare status at week 13 (source — survey) : 

—Yes— received AFDC, general or refugee assistance 
—No — received no public assistance 

Received layoff notice at application (source — MIS) : 

—Yes 
—No 

Labor- force status at application (source — MIS) : 
—Employed 

—Unemployed (not working but looking for work) 
—Not in labor force (not working, not looking) 

Date last worked at application (source — MIS) : 
Converted to a single decimal number— units are years. 

Wage of last/ current job at application (source — MIS) : 

Hours of last/current job at application (source — MIS) : 

Family income at application (source — MIS) (this variable 
converted to logarithms to reduce skew) : 

Weeks worked in year prior to application (source — MIS) : 

Labor-market experience (source — survey) 
Defined as number of years since last enrolled in full- 
time school during which respondent worked at least 6 
months. 

17 
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CHAPTER 3 
FINDINGS 



The findings are organized into six sections. Section one 
presents basic descriptive data for all variables used in the 
analyses. The remaining sections focus on five outcome variables. 
The outcomes are (1) weeks worked during the 13-week follow-up 
period, (2) employment status during week 13, (3) earnings in week 
13 for those employed during the 13th week, (4) welfare status 
during week 13, and (5) school attendance status during the 13- 
week follow-up period. The intended impact of JTP programs on the 
first four of these outcomes is clear; JTP is supposed to increase 
weeks worked, increase the chance of employment, increase pay, and 
reduce the likelihood of receiving public assistance. Its inten- 
ded impact on schooling is not so clear. Under certain circum- 
stances, it would be desirable to stimulate school attendance; in 
other cases, work might be viewed as an alternative to school. 
Schooling is included as an outcome because it is a major activity 
that tends to compete with work.^ 

Sections two-five of the chapter focus on independent 
variables that may influence the five outcomes. Section two ana- 
lyzes demographics — age, race, and gender effects. Section three 
examines effects of JTP Ohio services and reason for termination 
from JTP. Section four investigates SDA effects, and section five 
analyzes effects of several additional variables, including educa- 
tion and welfare status. The last section sxxmmarizes the 
findings. 

The analysis of the effects of services, effects of reason 
for termination, and SDA effects are designed to provide a prelim- 
inary model for using data of the typt: analyzed here to evaluate 
JTP programs. Two key issues are addressed. First, to what 
extent do SDAs differ on the five outcomes after controls for 
background variables that influence the outcomes are implemented? 
Second, to what extent are SDA differences due to the quantity and 
effectiveness of services provided. Only preliminary answers to 
these questions can be provided here due to lack of data on local 
labor market demand and lack of a comparison group; however, the 
preliminary findings are indeed interesting. 



Descriptive Data 

The means and standard deviations of each variable used in 
this report are shown in table 1. The generally low socioeconomic 
status (SES) of the sample is revealed in these statistics. The 
percentages of respondents (adjusted for nonresponse rate and SDA 

^Ideally, a simultaneous analysis of the impact of work and 
school on each other would be conducted, but this analysis is 
beyond the scope of the present report. 
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NCAM AM) ITAMMAO DCVIATKNI FOR All VAAIAILES 
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Prior to Appilcotfon 
Utlforo Stotui ot JfMi4«M4on 
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•lack 
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AfDC iocipfwit it Appilcatlon 
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Excaadid 90 Day Hold Status 

Lou AttandSnco 
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Agaa 55« 

Handicap 

Dropout 

S0B» Collaoa 

Col logo Oraduata 

OffandK 

Not In Labor For^o 
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Prior to Application 
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Application 
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to Application 
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Job Sosrdi A* ) Im^K^f 
Classroon Tralnlnp 
On tha Job Training 
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LMEXPEft 

ununci 

UEISTA2 

SEX 

LEP 

■LACK 
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AFOOIPL 

QENNLAPL 

T00LQN6 

EXNOLD 

IQATTEND 

AflES054 

AfiE55PL 

NANDICAP 
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SNOOL 

COLORAO 

OFFENDER 
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LAnURICI 

LASTUGEI 
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LAYOFFN 
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JSSRCN 
OCC aAS 
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8P1.6 


57.679 
50.274 
206.720 
7.655 

9.100 
6.066 
16.409 

29.479 
52.506 
.779 
12.256 
S.S34 
29.174 
17.900 
2.612 
9.191 
9.762 
51.747 
1.670 
7.067 
27.911 
16.611 
2.612 
9.146 
14.465 
74.547 
2.554 

84.111 

1.167 
1.277 
10.286 

117.111 
18.217 
12.004 
25.679 
10.815 


49.411 
49.117 
117.615 
5.801 

28.777 
7.272 
16.11( 

45.601 
49.941 

6.790 
46.750 
17.954 
45.460 
38.119 
15.951 
28.892 
29.665 
49.974 
18.801 
25.663 
44.861 
39.085 
U.589 
29.111 
35.178 
43.564 

8.566 

2.855 

2.652 
3.810 
45.953 

148.134 
48.596 
46.653 
43.690 
31.059 


5634 
4012 
2367 
4002 

3974 
5634 
5634 

4012 
5634 
5634 
5634 
5634 
5634 
5634 
5614 
5614 
5614 
5614 
5614 
5614 
5634 
5634 
5634 
5634 
5632 
5632 
5614 

4240 

5634 
5634 
5634 

5438 
5634 
5634 
5634 
5634 


TWQPAR 
OTNFAMN 
SP 617 


26.019 
7.056 
.150 


43.878 
25.611 
.357 


5634 
5634 
5634 
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sampling stratification) employed at follow-up was under 60. The 
average weeks worked out of 13 is only 7.6. The average weekly 
earnings for those working in week 13 of the follow-up period was 
$206; this calculates to $895 gross earnings per month. Over 29 
pf^rcent were on welfare. Over 30 percent are black. Thirty 
percent had received notice of layoff at the time of application. 
These data document the special nature of the sample. 

Generalisation of the findings reported here to the entire 
population w^uld, of course, be risky. So long as the profile of 
JTP clients remains stable, however, generalization to JTP clients 
is not threatened. 

Age. Race, and Gender 

This section analyzes differences on the five outcomes by 
age, race, and gender. The presentation proceeds in stages from 
simple to complex. First, bivariate differences on the five 
outcomes are shown by age, race, and gender. Second, a multiway 
crossbreak showing simultaneous differences on the outcomes by 
age, race, and gender is examined. Next, a multivariate analysis 
including simultaneous controls for several variables that are 
likely to influence the outcomes is presented. Finally, the age- 
race-gender tables are presented separately by welfare status at 
the time of application. 

Table 2 shows the bivariate associations between each of the 
5 dependent variables and age, race and gender. Although all 5 
variables display some differences in average value or percentage 
across the 3 age categories, the differences are statistically 
significant only for earnings, school attendance, and welfare 
status. Age shows a strong association with earnings and welfare 
status. The association between age and earnings is curvilinear. 
From the youngest age category to middle category earnings 
increase; they decline again when comparing the middle category to 
the oldest category (55 and older). Of course, the relatively 
small number of respondents (128 completers ) in the oldest age 
group could account for the apparent nonlinearity, but the curvi- 
linear relationship between age and earnings has been observed 
frequently in past recearch (e.g.. Mincer 1974). Additionally, a 
nonlinear regression using the exact age variable rather than the 
three category grouping was conducted with earnings and log earn- 
ings as outcomes. These regressions show a strong nonlinear 
component of the relationship between age and earnings. ^ 

The relationships between age and welfare status and between 
age and education status also are not linear, but the changes 
across age groups consistently decline. The percentage attending 



^In these data, the regressions show that earnings per week 
increase until approximately age 36-40 and decline thereafter. 
The earnings and log-earnings specifications agree fairly closely 
regarding age of maximum earnings. 
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7.58 


8.17 


6.34 
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59.01 


62.28 
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62.24 
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1H.00 
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179.27**** 


214.19 


181.88 
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230.63 


178.52**** 
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10.15 


8.74 


2.76** 


7.91 


11.42 


13.20*** 


7.83 
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Utifar* statu* h 

roll on* u#. Mrctfita«« of 

IndfvldiMis on Utlfar«. 


52.19 


28.81 


9.03**** 


23.77 


42.47 


27.69**** 


23.05 


36.08**** 




49.17 


7<^.65 


78.53 


73.44 


65.69 


66.47 


69.24 


73.28 




H0% 


2863 


183 


3998 


1466 
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2887 


2747 



iOTCf: All valiit* Mct^t r«tpofiM rattt ar* M#ffht«4l t« cowpiniaf for 

dffftront oonplffit rotoo ocrooo SDAt ond dffforont co«plotfon rotoo by 
tupioyont ttotiis at tontlnotlon «nd by Molforo ttotuo at torafnatfon. 



Saaplo tltaa aro nuabar dtum fn aaapU* not mffibar of coaplotort. 
To ffnd tho mflbor of co«plotora« auUfply tho roaponao rata by tha 
aaapla afia. 

* 

** |K..0t 

*** p< .001 o 1 

***• |M .0001 ^ ^ 



school decline slowly between the youngest and middle age cate- 
gories and much more rapidly between the middle and upper age 
categories. Neither of these nonlinearities are strong, however. 

The relationships between race and the five outcomes corre- 
sponds to past findings (e.g.. Parcel and Mueller 1983). Blacks 
in this sample work less and earn less than members of other 
races. They attend school more often than whites and less often 
than other nonblacks. They also are much more likely to receive 
public assistance than members of the other two racial categories. 
Also in line with past findings, females earn less and work less 
than males. They also are more likely to attend school and more 
likely to be on welfare than males. 

Table 3 shows the simultaneous three-way cross-classification 
of means/percentages for the five outcomes by age, race, and 
gender. Cell sizes including the oldest age category and the 
••other" racial category, often are too small to justify strong 
conclusions. However, the primary patterns observed in table 2 
tend to persist in table 3. Where sample sizes are adequate, the 
curvilinear relationship between age and earnings is observed.^ 
Where sample sizes are moderate to large, blacks generally earn 
less and work less than whites or others. Black females in the 
middle age group seemed to earn slightly more than white females 
in the same category, however, the difference in earnings between 
blacks and whites is much smaller among females than among males. 
Females also earn less and work less than males. The earnings 
discrepancy between males and females is smallest amonq blacks. 
The large differences between blacks and nonblacks in che likeli- 
hood of receiving public assistance also holds up within age and 
gender categories. 

The data in table 3 are multivariate; they present relation- 
ships between each independent variable (age, race, gender) while 
controlling for the other two independent variables. It is possi- 
ble to examine how the relationship between any outcome and each 
independent variable differs across levels of the other two inde- 
pendent variables. This detail comes at the expense of loss of 
sample size and difficulty of interpretation, however. 

The data in table 4 present a multivariate analysis that is 
different than the data in table 3. Each average/percentage in 
table 4 is adjusted for an array of control variables. Separate 
multiple regressions were conducted for each outcome. Each 
regression equation contained age (using the same three categories 
as before), race, and gender plus numerous additional controls. 
The means are adjusted in such a way that their differences always 
equal the value of a corresponding regression coefficient and 
their weighted average over all categories of each independent 
variable equals the overall average (grand mean) see chapter 2. 

^Statistical tests of all the possible relationships are not 
reported because there are too many of them to tabulate 
conveniently. 
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NEANS/PCRC€IITAa€S ^OR FIVE VMIAILES lY RACE, GENDER, ANO AGE (MULTIVARIATE) 
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A 21 


7.72 


7.23 


7.68 


6.54 


8.74 


5.86 


5.69 


9.04 


9.37 


3.00 


7.81 


7.98 




AwoTAfft HMkiy Eorfiln99 at 


222. 3t 


262.57 


231.43 


180.96 


182.60 


116.94 


178.21 


200.49 


208.11 


162.09 


t86.63 


94.32 


219.44 


273.43 


320.00 


165.20 


264.30 




Ewpioymnt Rat« at 
FoUoM-Up 


65.47 


65.16 


62.51 


58.11 


61.07 


58.27 


61.94 


49.58 


65.47 


43.10 


41.15 


39.73 


62.07 


66.93 


100.00 


53.04 


58.55 




EdMCttion Status at 
FoUoM-Up. I»*rc«nt«9« of 
lntf{vl4uo4o Rocoivint 

R^MCOtfOII 


7.17 


7.04 


0 


9.82 


9.08 


4.51 


14.39 


6.13 


9.37 


12.20 


13.54 


0 


18.96 


6.06 


0 


16.61 


9.85 




Uolforo Stattii at 
FoilOM-Up. rorcontoft of 
IndWIduoU on Uolforo 


21.09 


20. ia 


0 


32.95 


26.57 


8.76 


28.81 


36.56 


14.49 


59.54 


44.74 


32.82 


27.73 


14.86 


0 


31.19 


44.84 
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75.58 


79.71 


72.66 


77.31 


76.19 


60.52 


60.37 


92.86 


67.36 


71.15 


68.75 


68.52 


60.87 


100.00 


73.33 


64.10 




SMplo Siio 
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1060 


69 


826 


974 


63 


309 


3?8 


14 


383 


416 


16 


54 


46 


1 


30 


39 


0 



NOTES: Tfio ovoroil difforoncoo MMnt tlio ■••no/porcontoo** in this tabio oro highly ttatisticol ly ifgnificant for all 5 variables <p <..0001). 
Individual cooiMrisont oro too nvMMrous to diopioy. 

All tfoiuoo oncopt roopomo rotoo oro MOightod to cooponsato for difforont aaaiplino rates across SOAs and different completion rates by 
oapioynont stotuo ot tonoinotion ond by uoiforo status at termination. 
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ADJUSTED MEANS FOK FIVE VARIAtLES IT AGE, lY lACE. AND IT GENDER 



VariablM 


A9t 


Rsca 


Gandar 


22-29 


50-54 


55* 


Uhita 


Hack 


Othtr 


Mala 


FMla 


Avrm IMter of UMkt 

Uarkvl DuriM Folltti-Ub 


7.91 


7.45 


6.97* 


7.76 


7.27 


8.76*** 


7.50 


7.78 


Eiyicywot Ratt tt 
FoUoM-Up 


QU«& 1 


M 01 


n OS 


59.14 


55.66 


64.90 


56.88 


59.82 


AuftTM* Ui^flklv EM^inos 

at foiloi«*IJ^ 


199.66 


215.07 
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NOTES: AU valuss axcspt raaponaa ratsa art wai^ttd to coMpansata for difftrant sa«plinQ ratat across SOAs and differant 
coaptation rataa by OTployasnt status at application and by uaifara status at appiUation. 



• P<.-05 
*• P<..01 
**• p<..001 
p<..0001 
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Thm ind^p^ndont variables Includad In tha ragraaalona ara as 
follovat 

o Aga (3 binary varlablaa-— aga 30-54 and aga 55 & oldar) 
o Raoa (2 binary varlablaa — black, othar) 
o Oandar 

o Education (3 binary varlablaa—dropout, aona collaga, 
oollaga graduata) 

o Waif ara atatua at application (2 binary varlablaB«**AFDC, 
ganaral) 

o Walfara amount (dollara) at application 

o Family atatua at application (four binary varlablaa«*-alngla 
parant with chlldran undar 6, alnga parant with chlldran 
agaa 6 to 17, parant In tvo parant family, othar family 
mambar [unralatad Individual omlttad]) 

o Barrlara to amploymant at application (thraa binary varl- 
ablaa-*LEP, handicap, offandar) 

o Racalvad layoff notlca at tlma of application 

o Labor forca atatua at application (t%»o binary varlablaa-* 
una^ployad, not In labor forca) 

o Data laat vorkad at tha tlma of application 

o Waga of laat job at tha tlma of application 

o Houra of tha laat job at tha tlma of application 

o Log of family Incoma at tha tlma of application 

o Waaka vorkad in yaar prior to application 

o Labor markat axparianca (aatimatad from tha aurvey) 

o Whathar racalvad occupational claaaroom training 

o Whathar racalvad OJT 

o Whathar racalvad job aaarch aaaiatanca. 

o Raaaon for tarmination (four binary varlablaa— 
antarad amploymant, axcaadad program duration limits 
[C12], axcaadad 90 day hold [C14], low attandanca 

[C06, 007]) 
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A complete definition of the variables is given in the previous 
chapter. 

The extensive set of control variables used to produce the 
results in table 4 statistically "equalize" the effects of differ- 
ences anong participants that existed prior to their entry into 
JTP Ohio. Despite the use of these controls, older workers, 
blacks, and feaales were still found to earn less than younger 
workers, whites, and sales. Since these controls include indica- 
tors of education and work experience (human capital) that influ- 
ence earnings, the results suggest that age, race, and sex 
discrimination operate in the labor market faced by JTP Ohio 
participants. 

The much higher incidence of public assistance among females 
shown in table 2 is eliminated when controls for preexisting 
differences among participants are used to produce the results in 
table 4. Welfare status at application was one of these control 
variables. The elimination of the gender difference by con- 
trolling welfare status at application means females are no more 
likely to change their status from application to follow-up than 
males or nonwhites. Racial differences in the percentage 
receiving welfare are also substantially reduced by the controls, 
but remain statistically significant. Blacks are more likely 
than whites or other minorities to receive welfare at follow-up, 
even when their welfare status at application is controlled. 

Table 5 displays the relationships between each outcome and 
age, race, and gender separately for those who were receiving 
public assistance and those who were not receiving public assis- 
tance at the time of application. The advantage of table 5 over 
table 4 is that one can determine from table 5 whether the basic 
relationships are diffei^ent for those receiving public assistance 
at the time of application than for those who were not. Table 4, 
on the other hand permits more controls since the type of inter- 
actions allowed in table 5 are assumed not to exist in 
table 4. 

The primary patterns of differences in the outcomes among the 
age categories, among the racial groups, and between males and 
females are the same irrespective whether or not the respondent 
was receiving public assistance at the time of application. 
However, racial differences in earnings are stronger among those 
not receiving public assistance at application than for those 
receiving assistance. 

Table 6 presents the simultaneous cross tabulations of 
means/percentages on the five outcomes by welfare status at appli- 
cation, age, race, and gender. Sample sizes here often are too 
small to allow firm conclusions, but the main patterns observed in 
table 3 also show up in table 6. An interesting anomaly in the 
table is that the percentage of black males receiving public 
assistance at application who were employed at follow-up drops 
precipitously between the youngest age group (51.66 percent) and 
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TMt 5- Continued 
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UtlfaM Status at 
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NOTE: All values axcept rtsponso rates ars weighted to coMpensate for dlff^ent sanpllng rates across SDAs and by welfare status 
and CMploywent status at application. 



Sa«plt sizes are nuiter drawn In ssnple, not nuiber of completers. To find the nmber of completers, nultlply the response 
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r.5o 


6.93 


10.47 


6.66 


4.17 


4.36 


5.27 


6.20 




Cm>l«yMnt at 


54.02 


53.07 


a.36 


51.66 


29.07 


24.81 


40.30 


43.01 




A¥trio» Umkiy Umktm ^ 


213.40 


237.32 


219.54 


159.96 


215.65 


194.00 


192.20 


2!3.30 




Mmtlfln Otatui at 
InilvMiftlt tmlvino 


7.72 


7.59 


0 


16.71 


6.9 


0 


10.69 


0 




Mfart Otaout at 
Poilawl^. Paro«ttaoa of 
IndfvlteU an Wilfar« 


47.36 


4A.70 


0 


52.90 


60.00 


75.17 


69.37 


42.65 




Oaaponaa Oata 


M.67 


70.15 


50.00 


54.35 


57.92 


00.00 


56.52 


56.52 




Nuiter in Utagory 


447 


479 


6 


101 


202 


5 


23 


23 


0 
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P«mIm: Not Uttfart Racfpftntt 





Uhlta 


Slack 


Othar 




A9t 


Aga 


Aga 


Varfibltt 


22-29 


30-54 


55+ 


22-29 


30-54 


55* 


22-29 


30-54 


55* 


Av»r«ot mater of Uatkt 

Itorkid durfm Folion-Up 


9.29 


8.49 


7.31 


7.96 


7.37 


7.01 


9.45 


11.39 




CiployMnt tato at 

FolloiMJ|> 


71.06 


67.71 


5e.48 


63.99 


57.81 


47.26 


86.18 


79.34 




Avarata Uaakly Eamfngt at 

FoiiOM-U)) 


184.98 


186.21 


110.53 


171.62 


179.Z3 


91.09 


188.07 


351.32 


-- 


Education Statua at 
Foiloii*U|>. ^areantaga of 
Indfvlduala llaeolvino 
Edieatlen 


9.12 


8.90 


3-59 


4.68 


8.69 


0 


24.43 


0 




Ifalfara Status at 

FoUoii*lJ0. ^rcantaga of 
Individuals on Uaifara 


7.49 


7.91 


3.40 


16.14 


10.59 


24.60 


0 


6.71 




ftaaponaa Rata 


76.95 


79.62 


74.55 


62.69 


71.30 


66.67 


100.00 


64.71 




ttuafaar fn Catagory 


295 


476 


55 


67 


115 


12 


4 


17 


0 


Itolaa: Not Uaifara ftac^piants 




Uhita 


Black 


Othar 


Varfabiaa 


Agt 


Aga 


Aga 


22-29 


30-54 


55* 


22-29 


30-54 


55* 


22-29 


30-54 


55* 


Avaraga Nuiter of Uaaks 
Uorkad during Foiiow-Up 


9.39 


9.20 


8.09 


8.42 


8.86 


9.79 


11.00 


11.03 


3.00 


EaployaMnt Rata at 

FolioM-Up 


71.05 


69.32 


62.19 


69.45 


68.80 


75.17 


73.33 


79.29 


100.00 


Avaraga Waakiy Eamfngg at 
FoiioM-Up 


225.58 


272.35 


230.95 


188.12 


194.07 


209.22 


227.18 


288.22 


320.00 


Education Statua at 
FolioM^Up. Parcantaga of 
Individuals RacaWing 
Education 


6.90 


6.76 


0 


12.71 


5.37 


11.60 


23.38 


9.52 


0 


Uaifara Status at 
FoiioM-Up. Parcantaga of 
Individuals on Uaifara 


8.27 


6.71 


0 


11.23 


12.92 


0 


6.20 


0 


0 


Rasponaa Rata 


71.91 


76.42 


82.54 


66.41 


64.29 


100.00 


77.42 


65.22 


100.00 


NtMbar in Catagory 


559 


581 


63 


128 


126 


9 


31 


23 


1 



NOTES: Tha ovarall diffarancas anong tha naans/parcantagaa in this tabla are highly statistically 
significant for all 5 variablaa <p <..0001). individual ccnparisona ara too numtrous to 
display. 



All valuaa axcapt raaponsa rataa ara waightad to coapansata for diffarant sampling ratas 
acroaa SOAs and diffarant complation ratas by amployment status at tarmination and walfara 
atatua at tanaination. 

SiRv>la sizas ara nuHter drawn in saii|>ia« not miter of coaplatars. To find the nunber of 
coa9>latora« aultiply tha rasponaa rata by tha sampla siza. 
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th« mlddlj ag* group (29.87 p«rcttnt) . No oth«r diff«r«nc« in 
•aployMnt nf of this aagnitudtt occurs across ags groups. Ths 
saapls sisss (coaplstsrs - 102, 117), though fairly saall, ars not 
sMll snough to havs gsnsratsd this diffsrsncs through randon 
•sapling arror. This finding suggssts that rscsiving wslfars «ay 
havs a fundamsntally diffsrsnt impact on oldsr black »«n than on 
young black nsn. 

Tabls 7 shovs adjustsd asans by ags, by racs, and by gsndsr 
ssparatsly for thoss on public assistancs at application and thosa 
not on puLlio assistancs. Idsntioal procsduras usad for tabls 4 
wsrs ussd hsrs, (sxcspt that vslfars status at application was 
oaittsd froa ths rsgrsssion spsoif ications) . Ths curvilinsar 
ralationship bstwssn aga and aamings and racial diffarancas in 
•amings notad abova raaains for thosa not on walfara at applica- 
tion, but aamings diffarancas by aga and raca do not occur among 
walfara raoipiants (at application) . Qandar diffarancas in aam- 
ings ara strong irraspsctiva of walfara status at application. 
Racial diffarancas in waaks workad occur for both walfara raoipi- 
ants and thosa not racaiving walfara. Candar diffarancas in waaks 
workad occur only aaong walfara racipiants at the tiaa of applica- 
tion. 



JTP Ohio Sarvicaa and Raanona fn r Taraination 

Sarvicas racaivad by JTP Ohio cliants wara classified into 
three types— occupational classrooa training, OJT, and job search 
a«sistance. Reasons for teraination were classified into five 
categories: (l) entered eaployaent, (2) exceeded prograa duration 
limits (C12), (3) exceeded 90-day hold liait (C14), (4) poor 
attendance (C06, C07), and (5) other. A priaary goal of the 
analysis is to deteraine the iapacts of services and reason for 
teraination on weeks worked, eaployaent, earninga, welfare status, 
and schooling. 

In conducting these analyses, it was assuaed that services 
and reason for teraination are sequential rather than simulta- 
neous, as depicted in figure 1. 




JTP 
S^rvicM 


b 






Outcones 






Predeterained 
Variables 




Reason for 

Teraination 



Figure i. Model of effects of services and reason for termination 
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TABLE 7 



ADJUSTED MEAMS/PERaNTAGES ffM FIVE VAKlAtLES FOR WELFARE RECIPIENTS 
AND NQMCLFARE REClPiENTS lY AGE« lY RACE« AND lY GENDER 

Wilfart R«clpltnts at AppUcatlon 



ERLC 



VwlablM 


Aflt 


Ract 


Gandtr 




30-^ 


53^ 


Uhltt 


Slack 


Ottiar 


Nalt 






6.31 


3.88 


4.95 


6.43 


5.57 


6.57»** 


5.71 


6.37* 






44.61 


41.74 


48.37 


41.46 


47.32** 


43.19 


47.31 




184.11 


199.35 


202.06 


195.30 


187.77 


188.20 


216.47 


172.53**** 


1 




9.39 


12.17 


16.93 


9.82 


12.39 


9.23** 


11.53 


10.32 




S6.83 


56.13 


57.87 


53.47 


60.95 


51.99** 


57.90 


55.36 


Not Wtlfare Raciplents at AfrKcation 


varltblaa 




Ract 


Gander 


22-29 


30-54 


55* 


Uhftt 


Hack 


Other 


Nalt 


FaMle 




9.20 


8.69 


8.06 


8.83 


8.73 


10.66* 


8.83 


8.91 




71.38 


66.69 


62.32 


67.83 


66.3^ 


60.94 


67.24 


69.99 




208.71 


222.91 


179.94** 


220.83 


188.92 


270.85**** 


233.03 


186.94**** 


idntlan Stitut at 


6.16 


8.78 


9.25 


7.55 


7.72 


12.23 


7.85 


7.58 


1^1 


statyt at 


8.74 


8.14 


5.13 


7.25 


11.71 


2.37** 


8.32 


8.03 



NOTES: Statfatfcal afgnfffcanca rtfart to taata of hypothaaU that all 
fnatructlon) art aqual. 



for a given independent variable (e.g. claaarooii 



All valuH are uelghtad for nonresponae biaa eeployment statue at application and welfare statue at application and 
for eawpling at ratification by SOA. 

* p< .05 

** p< .01 

*♦* p< .001 

p< .0001 
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To obs^rva th^ tfital ^ttmctm of ••rvic^s, one must •xcluds control 
for reason for temination. To obsarve the dlract affact of 
aarvlcaa, control for raaaon for taraination auat ba addad. In 
flgura 1, tha diract affact la rapraaantad by arrow b. Tha total 
affact ia tha sum of tha diract affact and tha indirect affact: 
b ^ af . 

Aa a baaa of comparison, tabla 8 ahova tha bivariata 
ralationahipa batvaan aach of tha outooaaa and typa of aarvica; 
thaaa diffarancaa show tha basic ralationships without any con- 
trola. Tabla 9 displays tha saaa ralationships, firat undar 
control for all indapandant variables except reaaori for tamina* 
tion, then for all tha factors used as controls in previous tables 
including reason for taminetion. It is clear froa tabla 9 that 
the JTP services do influence the outcoaes. The tSjOL effects of 
all three aarvicea are poaitiva on weeks worked and eiqployaent at 
follow-up, and they are negative on the likelihood of receiving 
public aaaiatanca. Additionally, claaarooa training and OJT 
improve eaminga. All thaaa effecta are highly statistically 
aignif leant and fairly atrong. Tha j^a^al effecta of the three 
typea of services on education atatua are negative and 
algnificant. 

Tha ivportanca of reaaon for termination aa a mediating 
factor between aarvicea and tha outcomea ia amply aupported in 
table 9. All the total effecta are aubatantially reduced after 
controlling for reason for termination. Effecta of job aearch are 
entirely due to reaaon for termination, except on education 
status. This reault regarding job search ia aenaible. One would 
expect that ita impact on employment variablaa after 13 weeks 
would be determined primarily by whether the job aearch waa 
aucceaaful. A aucceaaful job aearch ia indicated by **entered 
employment." Entered employment is the most important category of 
tha variable reason for termination. 

It ahould alao be noted that a aubatantial part of tha total 
affect of OJT on weeka worked and esqploymant at follow-up alao 
operatea through reaaon for termination. It ia likely that nany 
individuala receiving OJT continue working in the firm where they 
received the OJT after ending their JTP-sponaored training. 

It ia poaaible that job aearch is more effective when com- 
bined with good claaaroom training or OJT than when uaed in isola- 
tion. To teat thia poaaibility, job aearch x claaaroom and job 
aearch x OJT interactiona were included in additional regression 
analyaaa (not included in any of the tabulationa) . Thaaa regres- 
aiona included the full coiq>lement of independent variables used 
in other calculationa plua the interaction terma (aee Pindyck and 
Rublnfeld [1981] for deacription of Chow teat). Most of the 
interaction terma were not atatiatically algnificant. However, 
the negative direct effect of job aearch on achool attendance 
holda only for thoae who did not engage in OJT; the direct impact 
of job search on achool attendance is essentially zero for those 




^.4 
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TAILC 8 

AVERAGES/PECENTAGES FOR P!VE VAKIASIES lY ifPE OF SERVICE 



Typt of S«rvlc« 





Claaaroon 

Instruction 


Job Saard) 


OJT 


Otptndtnt 
VarfablM 


Yas 


No 


Yts 


No 


Yts 


No 


Avtragt Nuiter of Uitkt 
Uorkid durfno FoUow-Up 


7.49 


7.70 


7.79 


7.54 


9.99 


itHHH 

6.71 


Ei^ployMHt Ratt at 
Foll0M*Up 


57.47 


58.66 


59.94 


57.22 


74.03 


52.20 


AV9r«9* WMKiy incoMt 
at FoUoM-lip 


205.36 


207.37 


202.50 


209.51 


232.99 


•«** 

192.35 


Ml fart Status at Fol low-Up 
Parcantaga of Ttnafnaat 
on Ualfart 


32.14 


** 
28.18 


28.11 


30.34 


14.83 


35.13 


Edjcatfon Status at 
FoUow-Up Ptrcantagt of 
Tanifnats RtcaWfng 

Educatfon 


9.46 


8.94 


7.21 


*** 

10.31 


6.60 


10.08 


Ratpomt Rata 


71.96 


70.80 


71.57 


71.01 


75.31 


69.55 


Samplt Sfzt 


1970 


3664 


2054 


3580 


1628 


4006 



NOTES: StatUtfcal sfsnfffcsnca rafars to taats of hypothasfs that maars 
for a gfvan fndtpandant varfablt art aqual ovtr Itvsls of tht 
fndspsndant varlabla. 

All valuas txcspt rtaporit rataa art wtfohttd for nonraapontt bfas 
fay a^ployMnt status at appUcatfon anf* wslfart status at 
appUcatfon and for sai^plfno stratfff cation bf SOA. 

Sanplt alias art nuititr draun In s««plt, not muter of conpltttrs 

* p<_-05 
** p<_-01 
*** p<_.001 
**** p<_.0001 



mjmm ¥§§m/vmomnmt rat fiw )mumM tv TvPit or mvicis 



Typt of JTP SttTvicM 





CUmtoo* 
Toortinj 


^ 


OJT 




Itao 


No 


VOft 


Ho 


Too 


No 


'f^mn,m ftmbtt Tot iff 
M.lnH^ (Hr tf« 






7.64 


7.20**** 
7.4S 


9.99 
t.9S 


7.3aM* 


fNMlPM Toe iff 
'MtaH^ Olf iff 




5^«ii^*^* 

94.99^ 


9t.9» 


54.72**** 


79u93 


9a.oo^ 

' 96.92^ 


miriifi MMUy Tot iff 
immm at 

«oll«HJ|i iir iff 






aoi.Ts 


202.64 
20i«71 


299.07 
22i.ft 


t94.99**** 

199.0»^ 


Itoifaro Tot iff 
Statuo ot 

foitaHIp Dfr iff 


».7i 






90.29 


^64 

2^..4S 


S2.ir*** 

31 .a2**'* 


«U6atk» Tot iff 
Status iMTli^ 

#OilOMr^» ftfr iff 


6.ai 

4.94 




7.U 


10.49^ 
V9.31^ 


9.91 
6.6t 


9.9;»* 



NOrift: ttotiottooi of«iaficamo roforo to toott of tiypothoooo that tNo ooono for • 
t^^tm lii dipwidM H vorfoMo (o.«. claoorooA Inotructlon) oro 



ymium oro Moi#itod for nonrtiponot bioo by o^plo^Hnt ttotut at 
cation and uaifaro atattja at ii^lcation and for aaopiino atratlficatlon by 

p<_.01 

p<_.0i1 

px.-OOOl 
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who •ngagttd in OJT. Also, tha interaction term between OJT and 
job search In the regression for receipt of public assistance was 
significant and positive. This result Implies a weak tendency for 
combining OJT and job search to Increase the likelihood of 
receiving welfare. This evidence is not strong, however, and 
reqtulres replication before the relationship is established. 

The Importance of Implementing controls is well illustrated 
by contrasts between table 8 and table 9. Examinations of bivari- 
ate differences in table 8 suggests that occupational classroom 
training might have either no effects on the outcomes or slight 
effects opposite to those intended. Individuals takin^;^ classroom 
training average fewer weeks worked, are slightly less likely to 
be working during week 13, earn slightly less, and are a little 
more likely to be receiving pxiblic assistance than those not 
receiving classroom training. The difference in percentage 
receiving public assistance is statistically significant; the 
other differences are not. All those relationships with classroom 
training are sharply reversed in table 9 where extensive controls 
are Included. Furthermore, all the differences involving class* 
room training are statistically significant in table 9. Thus, 
without controls, classroom training appears to be ineffective or 
slightly detrimental to clients. With controls, quite the oppo- 
site conclusion is supported. 

Statistical controls increase the estimates of the effects of 
classroom training but decrease the apparent effects of OJT. 
Table 8 indicates OJT led to sizeable, significant increases on 
all of the outcome measures. When the controls are introduced in 
table 9, these increases, which reflect apparent effects of OJT, 
are still significant but not as large. 

Additional regressions not reported in any of the tables were 
carried out to help explain the effects of classroom training and 
OJT on the five outcomes. In these regressions classroom training 
and OJT were the dependent variables. The Independent variables 
were the same as before except thnt reasons for termination and 
the three types of JTP seirvlces were omitted. To summarize the 
findings briefly, the primary predictors of classroom training 
were foxind to be welfare status at the time of application and 
labor market experience. Those on welfare were more likely to 
receive classroom training than those not on welfare, and those 
with little labor market experience were more likely to receive 
classroom training than those with a lot of experience. The main 
variables affecting OJT were handicap, exof fenders, gender, race, 
and weeks worked in the year prior to training. Handicapped 
Individuals and exoffenders were less likely to receive OJT than 
others. Males were more likely to receive OJT than females, 
blacks were less likely to receive OJT than whites, and those who 
worked many weeks in the year prior to training were more likely 
to receive OJT than those who worked few weeks. Thus, the primary 
predictors of classroom training have a negative Impact on the 
five outcome variables; whereas, the main predictors of OJT have 
positive effects on the outcomes. These results help to explain 

o 37 
ERJC 21 



why th« bivariat* ralationahipa (table 8) batwaan claaaroon train- 
ing and tha five outcomaa ohanga aign and bacona atrong aftar 
oontrola ara introducad (tabla 9), but tha original bivariata 
aaaociationa batwaan OJT and tha fiva outcomaa ara raducad in 
vagnituda by tha addition of oontrola. In brief, tha explanation 
ia that hard-to-aerve individuala tend to be aaaigned to claaa- 
roo» training; whereaa, the oppoaite ia true of OJT. 

Tablaa 10 end 11 report bivariata and nultivariate adjuated 
Baana, raapactively, according to raaaon for termination, strong 
ef facta are aaaociated with the reaaon for termination. Thoaa who 
entered eaqployment are much more likely to be employed at follow- 
up, work about three timea more weeka during the 13-week follow-up 
period, earn about $9 more per week and are much leaa likely to be 
on welfare than thoae who did not enter employment, it ia aome- 
what anomaloua, however, that when oontrola are included those who 
exceeded the program duration (C12) earn more than any other 
group. The aample aise here ia fairly email (73 completers) but 
probably not small enough to account for the anomaly. 

The combined reaulta of table 9 and table 11 ahow that raaaon 
for termination ia a pivotal factor in determining the outcomaa. 
Table 11 documents that entered employment makea a atrong indepen- 
dent contribution to all 5 outcomaa. Table 9 ahows that reason 
for termination ia an important intervening variable between JTP 
aervicea and the outcomea. 



Service Dellvrv Xir^mm 

Thia aaction analyzes differences among SDAa on the five 
outcomea. if done carefully, auch analyaia might provide a basis 
for aaaeaaing SDK performance. The proviao, if done carefully, 
is critically important, however. Obvioualy, compariaon of 
bivariata differencea in meana or parcentagea among SDAa is inade- 
quate, becauae SOAs differ regarding important determinanta of tha 
outcomea and becauae labor market conditiona are not uniform 
acroaa SDAa. Examplea of potential differencea include unemploy- 
ment rate, racial compoaition, age, and aocioeconoaic atatus. 
Thua, for example, differencea of average earninga between the 
Cleveland 8DA and Franklin county could partially be accounted for 
by differencea in the percentage of blacks living in poverty in 
the two locationa. 

Table 12 reporta SDA difference in four atages. The firat 
column diaplaya bivariata differencea of meana or percentages 
(without any oontrola) . Theae data are preaented as a comparison 
baae. Column two ahowa differences after controlling for all 
independent variablea ix&tfi& JTP aervicea and reaaon for temina- 
tior.. Column three ahowa the differences aftar adding the three 
JTP acrvice variablea to tha independent variables already 
included. Column four adds reason for termination to the set of 
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TASLE 10 



AVERMI/raNZIITAfiES FCM FIVE ¥MIASLES lY KAMN FOR TEMIMATION 

RMton for Ttfufnttfon 



VarfiblM 


Entorad 
E^pioyMnt 
A01-A05 


ExcaaM 
Fro9rMi 

M2 


Excaadad 

90-Day 

C-U 


Poor 
Attandanca 

(C06,C07) 


Othar 


Av«r«9t NMbtr of UMitt 
Uorkod dMTfnt FoiiouHJ^ 


10.18 


2.2S 


3.81 


3.04 


2.9S 


EnpioyMnt UU at 

Foiiow-Ulp 


75.99 


23.03 


24.61 


24.64 


24.51 


Avtragt Uotkiy IncoM 
•t FoiioM-U^ 


214.94 


196.42 


164.43 


150.63 


168.98 


ytifart Status at Fdiow-Up 
Porcantaoa of Ttnaf nm 
on Utifaro 


16.81 


62.23 


51.47 


55.29 


4T.zy 


Edntfon Status at 
Foiiow-U0 Mrcantagt of 

Ttnifnota RoctWfng 

Edueatfon 


6.81 


9.41 


9.21 


10.15 


17.01 


Roapoma Rata 


76.73 


63.48 


65.38 


58.35 


61.84 


SMpla Siza 


5S20 


115 


494 


449 


1056 



NOTES: StatUtfcai sfgniMcanca rafar to taata of hypothaaU that ail naarw for a 
9ivan indapandant (a.g., aga) ara aqual. 

All valuaa axcapt ratponi* rataa ara vaightad for nonraaponaa bfaa by 
aaploymnt status at tamfnatfon and valfara status at tarsifnatfon and for 
plfng stratfffcatfon by SOA. 



SMple sizts are ranter drawn fn ssMplt, not raxber of conplaters. 

* p<_.05 
** p<_.01 
*** |X_.001 
**** p<_.0001 
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TiU« 11 

ADJutm NUM/moBiTMet MR fim mimM tv «uaai for tcrnimtiom 







IN^O^TMI 

(C12) 


fO-Doy 

(CU) 


1^ 

(C06.C07) 


OtKor 


HMnm «>i**r of MMks 


fo.ir 


S.41 




4.05 


3.80^ 


Uptiy— K Rata tt 


7^.99 


lo.n 


42.11 


32.04 


30.90»*^ 


Awan MMkly IneoM 


218.08 


2S0.16 


190.32 


170.43 


196.59**** 


Mlfm ttatui at PolloM-Up 
^Ofocntnfo of ToniHnMO 
onltolfaro 


19.41 


53.81 


41.39 


45.15 


41.77^* 


fduMtlon itotiA at 
PoUoM-IJ^ catitiji of 
ToralnMS Roctlving 


7.21 


8.77 


8.02 


8.68 


15.11*^* 



NOTES: StatUtleol siinlflconeo rofor to toot of hypothoaU thot oU aom for • 
flvon IndipmlMit vorfoMo (a.f. claaaroou fnatructlon) aro aquoU 



All ¥aluao aro walthtod for nonroaponaa bfaa fay anployMnt atatut at applf- 
cation and ualfora atatua at applicotfon and for aa«pl1no atratlffcatfon fay 

* p<..08 
*• P<..01 
p<..001 
p<..0001 
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TABLE 12 



MEAN/mCCNTAGE DEVIATIONS Of 
S)At fWm STATE MEANS/PEKCENTAQES: 
OiSERVED DEVIATIONS AND ADUSTED VALUES 



MiiitrtPifftrfnctf 

PrMltt«nilntd 
PrMltt«nilrwcl Varlabltt 



Pr«dittrfifned 
Varlabltt 
^JTP s«rvle«t 



S&i 




DlffTHC— 


VarliblM 


♦JTP ScrvlcM 


^OMon TtrM. 


SM «1 


UmIui Uorfc«d 




0.92 


0.86 


0.47 




GRployMnt 


10.86^ 


8.05 


7.85 


4.51 






• J.21 


0.23 


0.13 


1.76 




Eamfngs 




• 1.33 


- 3.43 


• 3.39 




School Atttndm« 


' 0.96 


• 1.98 


- 2.28 


• 1.72 


sDA n 


WMkt Worked 


0.54 


1.00 


0.71 


1.44** 




Enplof^nnt 


7.78 


12.13* 


10.61* 


16. 18*** 






- 3.85 


- 2.40 


• 1.45 


- 3.66 




Eamfnoi 


•35.13* 


-20.61 


-20.31 


•17.68 




School Attcrvknct 


- 0.53 


• 0.07 


- 0.12 


- 1.67 



Uttkt Uorkod 


•0.31 


* 0.68 


- 0.95 


- 0.54 


^ployMnt 


-3.68 


- 5.49 


- 7.44 


- 4.29 


Mlfare 


1.58 


- 0.62 


0.73 


- 0.88 


Eamfngt 


-14.89 


-17.60 


-23.19 


-22.59 


School Attandwnco 


- 1.32 


- 2.59 


- 1.87 


- 2.10 



SDA #4/5 



Uttkt Worked 
Eii|>loyMnt 
Welfare 
Eemfngt 

School Attendence 



-0.71 
-7.36 

8.83 
-25.36 

4.88 



0.10 
1.04 
3.49 
-7.06 
3.59 



- 0.28 

- 2.34 
4.27 

12.12 
3.96 



• 0.30 
- 2.22 

3.57 
-13.87 

^.54 



SDA 16 Ueeke Worked 
EmployiMnt 
Welfare 
Eamlnge 

School Attendence 



-0.55 
-3.25 
1.86 
9.92 
-2.19 



- 0.40 

- 2.32 
• 1.27 

11.30 

- 1.29 



0.69 
3.64 

0. 71 
8.33 

1. ao 



0.36 
4.32 

- 4.79 
12.86 

- 2.46 



SDA #7 Weeke Worked 
Enployeient 
Welfare 
Eamfnge 

School Attendence 



-0.52 
•1.09 
pII.52*** 
17.32 
-3.07 



- 0.95* 

- 3.86 

- 4.84 
16.09 

- 2.71 



- 0.52 
0.23 

- 7.77** 
23.00* 

- 3.80 



- 0.42 
0.03 

• 6.54* 
20.12 

• 5.17* 
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SAL. 



¥M>llbl>« ♦JT^ tf Vict 



10 J 



- 4.05 
1.50 

- 7.09 
10.72^** 



0.19 
0.79 
1.00 
3.55 



0.22 
1.42 

• 2.52 

• 2.75 





UmIcs yDTktd 


1.3t** 


0.99 


-0.16 


• 0 46 






10.18* 


8.06 


1 74 


- 0.19 




Wilfar« 


-11.44** 


- 9.15* 


• 5 04 


• 3.87 






1S.37 


11.05 


6.43 


6.17 




School AttondtTKt 


5.16 


4.28 


4.95 


5.03 


SM #10 


Uooki UDfkod 


0.75 


0.74 


0.86 


1.28* 




BilHoyMnt 


0.50 


2.39 


2.83 


3.94 




U»lfaro 


5.90 


7.49 


7.34 


5.79 






-30.84 


•37.92* 


-35.69 


-30.54 




School AttondMvt 


- 3.82 


-3.69 


- 3.32 


- 2.39 


SM #11 


IMtt Itorkod 


0.49 


0.82* 


0.84* 


0.99** 




U|>loyMnt 


3.05 


5.09 


4.85 


6.72* 




Utlforo 


0«38 


• 4.07 


- 3.55 


• 4.50 




emfnoo 


3.87 


-4.26 


- 5.54 


• 2.23 




School AttondwKO 


0.47 


-2.65 


- 1.92 


• 1.67 


SM #12 


Mokt ktorkod 


0.18 


-0.35 


• 0.26 


< 0.41 




lii|>loi)ptnt 


- 0.69 


- 5.36 


- 4.51 


- 5.26 




Uilforo 


3.15 


- 6.55 


5.65 


6.87 




Eominoo 


7.18 


8.59 


6.45 


3.95 




School Attondtnco 


• 1.03 


- 0.63 


- 1.49 


- 2.57 


SM #13 


Uioko Worlcod 


1.26** 


0.28 


- 0.68 


- 0.61 




EmployiMnt 


6.02 


- 1.07 


- 6.60 


• 7.52* 




Utlforo 


-15.24**** 


- 6.88* 


- 3.37 


- 3.70 




Cimfnoo 


90.48**** 


76.12**** 


70.08**** 


72.10** 




School AttondtfKt 


•5.21* 


-3.34 


- 2.90 


- 2.00 


SM #U 


UMkt Uorkod 


1.77*** 


1.09* 


0.09 


• 0.39 






15.32** 


9.85* 


3.12 


- 0.08 




yolforo 


•10.80* 


- 4.99 


- 0.07 


1.78 




EomfrtQt 


10.13 


3.64 


- 5.71 


- 5.24 




School Atttndinct 


• 3.38 


• 3.35 


• 1.17 


- 0.88 
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Adiutttd Difftrtncet 

Prtdttamlnad 
Pr«dtttrii1 md Var 1 abltt 
ObMrvtd Pradtttnilned Virlablta ♦JTP $«rv1ctt 
ay VariaM- Diffartncaa Variibl#a ♦JTP Srvic- ♦taaaon tt^. 



ilS Uaaka Uorkad 

Mfar« 
Eamlnfa 

School Attondanct 



0.79 

5.38 
-10.1«»* 
•15.71 
- 1.06 



- 0.05 

- 0.24 
' 0.94 
-26.01* 

- 1.36 



- 0.35 

- 2.23 

- 0.62 
-27.29** 

2.12 



- 0.26 

- 1.05 

.18 
-26.26* 
2.07 



SOA #16 Uaaka Uorkad 
Eiiplo)^Mnt 
Utlfaro 
Eamlnoa 

School Attondanct 



0.85* 

8.25** 

7.24** 

5.57 

3.20 



1.14*** 
9.99** 
• 7.83^ 
15.72 
- 3.03 



1.82**** 
14. 65**** 
-11.37**** 
22.80* 
-4.78* 



0.80** 
8.13** 
- 7.45** 
20.48* 
• 4.42* 



SOA #17 



SM #18 



SOA #19 



SOA #20 



SOA #21 



Uitka Uorkad 


0.33 


0.48 


0.31 


- 0.10 


Eiyloyant 


5.49 


6.75 


5.33 


1.66 


Hal faro 


- 2.23 


• 1.09 


0.18 


1.64 


Eamlnoa 


•17.32 


-11.82 


-12.58 


•12.51 


School Attondanct 


- 4.96* 


- 4.46 


• 3.54 


- 2.56 


Utaica yorktd 


1.60*^ 


1.33** 


1.36*** 


0.56 


CuployMnt 


11.38** 


9.28* 


9.41** 


4.27 


Utlfart 


- 7.24* 


- 4.89 


- 4.86 


- 1.96 


Eamlnoa 


- 8.58 


-10.66 


- 8.18 


- 9.65 


School Attondanct 


5.22* 


4.17 


4.30* 


4.75* 


Uttfca yorkad 


1.45 


0.67 


0.76 


0.05 


Enploynant 


9.72 


4.09 


4.95 


• 0.74 


Hal fart 


- 7.58 


- 1.27 


- 2.15 


0.60 


Eamlnoa 


23.65 


6.55 


7.23 


8.51 


School Attondanct 


- 0.29 


-1.13 


0.45 


1.33 


Uaaka Uorkad 


1.56**** 


- O.U 


•0.22 


0.08 


Eiyloywint 


-13.51**** 


- 5.19* 


• 3.93 


- 2.30 


Ualfart 


17.14**** 


5.68** 


4.94* 


2.86 


Eamlnoa 


-21.41* 


- 5.90 


-4.55 


- 5.24 


School Attondanca 


0.46 


• 0.74 


•0.80 


0.09 


*« i — llnrilfrl 

IftaiCB VOrKta 


-2.18**** 


• 1.84**** 


•1.30** 


• 1.01*^ 


Ei^plo^^Mnt 


•16.02**** 


-13.75*** 


-10.48** 


• 7.76* 


Ualfart 


6.57 


6.69* 


4.51 


4.29 


Earnlnoa 


-35.95** 


-30.68* 


•24.70 


-27.02* 


School Attondanct 


0.93 


• 0.05 


•0.59 


• 2.42 
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^To^tonMiwd 






















1 ¥ir<«M«o 


UXf torvfooo 






atffiwieoa 




♦JTP SorvloM 










• 0.28 


0.01 


8.S8 








- 2.83 


• 1.51 


UK 








1.26 


0.44 


• 1.77 








6.36^ 


9,f4 


H.tr 




tdiool Attinteict 


• 3.% 


- 5.98 


- 5.81 


• 1.07 






• O.rJ 


• 1.11^* 


- 1.i7*» 


• 0.98** 






• C.lf 


• 4.79 


- 4.24 


- 1.11 








5.80 


5.41 


1.18 






-20.21 


•32.0I^ 


-28.56** 


-88.80** 






- 1.92 


- 0.32 


• 0.59 


- 1.78 


MM KM 


««- -* * 


1.14* 


0.97 


0.S3 


0.86 






7. Of 


5.07 


1.95 


0.17 








• 4.18 


• 1.72 


• 0.S2 




Camlngt 


• a.rt 


-12.54 


-15.90 


-17.60 




Ic^l Atttndmt 


- 5.38 


•5.12 


- 1-75 


- 2.08 




Mrvta 


0.9S 


O.S 


0.25 


- 0.60 






6.73 


1.45 


1.56 


- 4.15 






•10.0P* 


2.05 


2.18 


S.64 






30.9S* 


22.36 


a. 21 


19.94 




Sckooi Atttndvm 




- 1.32 


- 1.20 


- 1.15 






- o.a 


- 0.46 


- 0.51 


- 0.75 






• 5.07 


- 4.59 


- 4.64 


- 5.92 






- 5.96 


2.05 


1.75 


2.67 






57. 10» 


15.61 


8.85 


5.35 




Solioot kXtmOancm 


- 5.29 


- 2.46 


- 2.96 


- 5.51 




ll^^Li^ » « - - * * 


- 0.26 


- 1.34 


- 1.%8 


- 1.63* 






- 4.05 


-12.01 


-12.63 


-15.21 






0.22 


9.09 


9.52 


10.07 






fQ.%f — - 


64.13** 


64.12** 


61.92* 




lolm4 Attanteot 


- 0.50 


1.26 


1.04 


0.71 


SM i2B 


UMk» ItarlDid 


0.21 


- 0.15 


0.54 


- 1.08 






1.17 


• 4.72 


- 1.88 


•11.18 






- 6.68 


- 0.95 


- 2.75 


2.75 






41.92 


18.76 


26.25 


22.06 




School Atttnteco 


- S.75 


- 4.00 


- 4.25 


• 5.70 



PrMlttariifncd 











ProdtttnHnod 


Vorlablto 






Qboorvod 


Prtdtttmlnod 


Vorlablts 


"^JTP Sorvfctt 




VarlablM 


Dfffortncot 


VorlablM 


♦JTP $«^«ctt 


♦^toton Itfw. 


SOA #29 


yttki york«d 


•2.90**** 


• 1.84** 


• 1.59^ 


- 0.4^ 






•27.13**** 




•18.02*** 


'10.40* 




Iftlfart 




17.65**** 




12.32** 






'10.18 


9.69 


7.36 


9.48 




School AttofidtfKo 


9.64** 




7.03* 




SM iSO 


Uitlcs Itorktd 


1.10 


0.17 


- 0.55 


- 0.36 




Bploywnt 


9.77 


2.88 


• 1.19 


0.54 




Utlforo 


• 9.13 


- 2.49 


0.01 


• 0.30 




Eomingo 


27.73 


- 3.89 


- 9.78 


-10.55 




School Attffvknco 


• 3.47 


- 2.85 


• 2.59 


- 3.60 


SOA #31 


Uitkt Uorkod 


0.25 


- 0.13 


• 0.57 


- 0.20 




Ei^iloyMnt 


3.01 


- 0.46 


• 3.35 


- 0.78 




Utlfart 


1.22 


5.30 


7.30* 


5.52 




Eomlnot 


10.47 


- 0.85 


- 6.84 


• 7.79 




School Atttndonct 


5.0S* 


5.8r* 


6.68** 


6.43** 



NOTES: Entrloo art dtvUtfont from statewide ovtroget or percentosot. 

All voluMf tncludlno stattwfdt avtragot/porcantaoM were uafghttd to conpansatt for 
difforant sa^^Ung ratat fay SDA and for diffarant co«platfon rataa fay aaploymant status at 
appUcatfon and fay ualfara status at application. 

Overall differences snong SOAs are stetlstlcelly sIgnHlcant at p <_.0001 for each variable 
In each colum. 

* p<_.05 
** pc_.01 
•** p<_.001 
**** p<_.0001 



lnd«p«nd«nt variables. Thm entries in table 12 are nean or per- 
centage differences between the SDA average and the statewide 
average . 



One would expect SDAs to differ regarding the five outcoaee, 
for a variety of reasons. This expectation is strongly confimed 
by the data in coluan 1. The statistical tests of overall differ- 
ences among SDAs (see note 4 to table 12) indicate that the varia- 
tion in averages and percentages anong the SDAs are highly 
unliJcely to be due to randoa sampling error. The chance that the 
differences are due to sampling error alone is less than 1 in 
10,000 for each outcome. 

The remaining columns reflect an incremental strategy of 
trying to identify Hhy SDAs differ. The hypotheses tested in 
column two are th&t SDAs differ on the five outcomes because they 
also differ on the predetermined controls (e.g., race, gender, 
labor market experience) . These hypotheses also are rejected for 
every outcome. The hypotheses associated with column three are 
that JTP services provided by SDAs account for differences in the 
outcomes across SDAs that are not already accounted for by 
predetermined variables. The data also indicate strong rejection 
of these hypotheses. Finally, colximn four tests the hypotheses 
that, after controlling for predetermined variables and JTP ser- 
vices, SDA differences in the outcomes are due to reason for 
termination (primarily entered employment) . Again the hypotheses 
are rejected, m summary, SDAs do differ on all five outcomes, 
and these differences are not entirely accounted for by predeter- 
mined differences among their clients, the JTP services they 
provide, or the entered employment rates (more generally, reasor 
for termination) . ^ j # - 

The statistical tests indicate whether differences are likely 
due to sampling error; they are not good indications of the size 
of the differences.' The main entries in table 12 show the 
deviation of each SDA from the statewide total. The statistical 
significance of these differences is indicated by asterisks (see 
notes to table) . It is clear from these results that the magni- 
tude of the SDk effects are reduced by the controls, with only 
very minor exceptions, the average magnitude (absolute value) of 
the SDA deviations from the statewide average or percentage 
decreases monotonically with each addition of a set of controls. 
Youngstown (SDA 29) is a particularly salient case in point. 
Without any controls, Youngstown respondents are 27 percent less 
likely to be employed at follow-up and nearly 31 percent more 
likely to be receiving public assistance than are individuals 
throughout the sta te. Youngstown responden'ws also work on the 

^As in all preceding calculations, entries in table 12 are 
weighted to compensate for differing sampling rates across SDAs, 
different response rates by employment status, and different 
response rates by welfare status. 

'Statistical tests depend both on the size of differences and on 
sample size. 
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average naarly 3 wMks less than the atatavide average. Intro- 
ducing controls for predetermined variables reduces the discre- 
pancy in SBployment rate to 20 percent, the discrepancy in weeks 
worked to less than two, and the discrepancy in receiving welfare 
to 18 percent. Adding controls for JTP services and reason for 
temination further reduces these differences. With all the 
controls, Youngsto%m respondents are only 10 percent less likely 
to be employed than the state total, work only about one-half week 
less, and are only about 12 percent more likely to receive public 
assistance. 

The results in table 12 are consistent with the model 
depicted in figure 2. This model is a generalization of the model 
in figure 1. In evaluating SDA performance, one is interested in 



JTP 
Services 




Figure 2. Mode] of SDA effects 

the sum total of all direct and indirect effects the SDAs. The 
direct effect is path c. This is the part that cannot be 
explained by SDA activities (services and placements) . The path 
ab is the indirect effect due to differences in the quantity of 
services offered by different SDAs. Path df is the indirect 
effect due to differences in reason for termination ( primer ily 
placement rates) among SDAs. Path aef is the indirect effect 
through both services and reason for termination. As shown in 
table 9, the primary mechanism is that classroom training, OJT, 
and job search enhance the chance of employment at termination, 
and employment at termination improves outcomes at follow-up. The 
paths involving 6, p, q, and r all represent spurious differences 
among SDAs — those due to SDA differences on the predetermined 
variables. 

Comparison of column one to column two in table 12 indicates 
the extent to which SDA differences on the outcomes are due to 
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diffsrences on the predetermined variables— that is, to what 
extent are differences in outcomes among SDAs due to variation in 
the types of clients served by different SDAs? Column one 
includes differences operating through fi, p, g, and r. Column two 
excludes these spurious differences but summarizes the total 
estimated effects of the SDAs— c + ab + df + aef . The primary 
evaluation of an SDA, based on these data, then, would focus on 
differences in column two. Column three and column four provide 
diagnostics. They address the question **To what extent can SDAs 
improve their outcomes by increasing services and being proactive 
regarding the reason for termination?** The answer yielded by the 
data is **to some extent,** but SDA differences not explained by the 
amount of services and placement rates remain. 

It is possible that some SDA differencer are due to the 
effectiveness (as contrasted to quantity) of their services. To 
test this idea, we ran regressions in which first order interac- 
tions between SDA and the three types of services (classroom, OJT, 
job search) were included. The idea here is that the effect of a 
service such as classroom training might be stronger in some SDAs 
than in others. The results of this analysis (not tabulated) did 
not show substantial differences among SDAs in the ef fectivc^^ness 
of their services. A slight tendency was detected for the effec- 
tiveness of job search in keeping individuals off welfare to vary 
across SDAs, however. Also, small but significant SDA x services 
interactions appeared in the equation for school attendance. 



Predetermined Variables 

This section presents analyses of the relationships between 
the five outcomes and five independent variables that are likely 
to influence the outcomes. These five independent variables are 
employment status at the time of application, family status at 
time of application, welfare status at the time of application, 
education status at the time of application, and barriers to 
employment me&aured at the time of application. All these vari- 
ables were included as controls in previous regressions; in this 
section we examine their effects. For each relationship, 
bivariate mean and percentages differences are presented as a 
basis of comparison and adjusted means are shown to assess net 
impacts of the independent variables on the outcomes. The inde- 
pendent variables included here and procedures for calculating 
adjusted means are the same as those used previously. 

Tables 13-22 show the results. Education has a statistically 
significant impact on all outcomes except school attendance during 
the follow-up period. Some of the patterns of relationships with 
education are not as anticipated, however, the observed mean 
earnings of college graduates is less than the mean for those with 
some college. The adjusted mean earnings of college graduates is 
below the mean for high school graduates. Additionally, the 
adjusted percentage of college graduates receiving public assis- 
tance is higher than the percentage for high school graduates and 
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TMLE 13 

MEANS/PEKCENTAGES FOK FIVE VARIAILES lY EDUCATION STATUS AT APPLICATION 



Eduration Status at TiM of AppUcatfon 



Varfablts 


Dropout 


H.S. Graduate 


SoMt Col lt9e 


College Grad. 


Avtrag* Muter of Ua«kt 

UDTkad durfne FoUow-UlP 


6.36 


7.93 


9.13 


9.61**** 


EifployMnt Rata at 
FoUow-Up 


48.05 


60.79 


61.27 


76.91**** 


Avtraga Uaakly Incoiat 
at FoUow-Up 


180.94 


208.60 


226.56 


215. 27**** 


Utlfart Status at Fol low-Up 
Parcantagt of TarMfnaat 
on Utlfart 


42.99 


27.19 


20.66 


13. 73**** 


Education Status at 
FoUou-Up Ptrcantagt of 
Ttmfntts RtctWfng 

Educatfon 


9.57 


7.76 


12.11 


1i.53*** 


Rtsponst Rate 


6 .13 


73.44 


74.83 


77.93 


Sample Sfze 


1553 


3054 


882 


145 



NOTES: Statistical significance refers to tests of hypothesis that all means for 
a given (^ pendent variable are equal across levels of education. 

Mi values txcept respcns* rates are weighted for nonresponse bias by 
CRploynent status at app'if cation and welfare status at application and for 
sanplfng stratif fcatfo^i by SDA. 

Sasple sfzes are nunber drawn in sample, not nurtber of completers. 

* p<..05 
•* P<_.01 
p<_.001 
•••• p<_.0(»1 
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TAKE U 

AOJUITCO MfANS/PCRCCIITAfiCS FOR FlVC VMIAiLES lY EDUCATION 



Cdjcatlon Itatut at TfMt of Appl feat ion 



VariiMaa 


Dropout 


U.S. oroouato 


%om Co(lo90 


fM 1 mam Cr^f 


AvoTiga Nuibtr of iMit 
Itorkad durir^ Fo(Iom-U0 


7.20 


7.69 


8.05 


8.29*** 


E^^ioymtC Roto at 


54.42 


58.97 


60.72 


67. 55*** 


Avorafo Uaokly IncoMt 


186.78 


208.95 


233.12 


188.26**** 


wot faro Statua at Follow-up 
Porcontato of Tonaintoo 
on Uilforo 


34,37 


28.79 


23.77 


31.47**** 

1 


Education Stotui ot 
Folloif-U)p htrcantago of 
Tominoaa ftocoiving 
Education 


9.35 


8.19 


11.33 


8.37 



NOTES: Statiatical aignificanco roftra to totta cf hypothoaia that all »oana for a 
9ivin dopandwtt variabio aro aqual acroaa levols of adication. 

All valuta art waightod for nonroaponao biaa lay aaiploywant atatui at 
a^lication and walfaro atatua at application and for aanpUnQ 
atratification by SDA. 

* p<_.05 
** p<,.01 
*** P<«'001 
**^ p<_.0001 
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TAILE 15 

AVCTAGES/PERCEHTAGES POR FIVE VARIABLES iY UCLPARE STATUS AT APPLICATION 



Mlfart Status at Tfnt of AppUcatfon 



Varfiblta 


AFDC Racfpfant 


Ganaral 


Nonuelfare 


Avvragt IMbtr of Uttks 

Uorfcad durfno PoUow-Up 


6.30 


5.64 


8.86»*** 


E«p(Qfywnt Rata at 
FoUomU0 


47.62 


41.29 


68.36**** 


Avaraga Uaakly Incont 
at Follow-up 


202.30 


166.89 


214.44**** 


Ualfara Status at Follou*Up 
Pareantaga of Taraifneat 
on Ualfara 


57.67 


54.28 


8.20**** 


Education Status at 
Follow-U0 Pareantaga of 
Tanifnaaa RacaWfng 
Education 


11.15 


10.13 


7.77** 


Reaponaa Rate 


71.22 


63.37 


74.36 


Saaple SUa 


2036 


1032 


2566 j 



NOTES: StatUtfcal afgnfficanca rafara to teats of hypotheafa that all means for a 
given dependent variable are equal over the three categoriea of welfare 
status (AFOC, gener'-l, no welfare). 



All values except response rates are weighted for nonresponse bias b/ eaploy- 
laent status at application and welfare atatua at application and for safnpUng 
stratification by SDA. 

Sample sizes are number drawn in sanple, not nunber of corpieters. 

* p<..05 
** p<..01 
*** IX--001 
**** p<_.0001 




TAILE 16 

ADMTO MANt/mCiliTAaCt Pm Pm VMIIAtLII tY WEIPAM STATUS AT A^UCATIQN 



Vtifart SUtui at Tfnt of AppifMtfon 





AFX Kocfpfont 


Sorwroi 


Momti foro 


Avirttt malm of liNkt 
UtrlBid4Mr1ni Po(ioii*U|p 




7.07 




tuyloi—il lot* at 
PoiioiMl^ 


62.72 


51. 7i 


sa.os*** 


A¥§ri^ llMkiy InccM 


206.90 


lOB.a 


213.03* 


llilfaro Status at Poiion Up 
^oroMtiso of Ttmlnioo 
on Uilfaro 


39.97 




17.96**** 


idueotlon Stotuo at 
PoiioM-U)^ Mrconti^ of 
Tonrintot Rocoivfnp 
Cdcotion 


7.96 


9.97 


9.45 



NOTCSs StotUtlcol olonfflMnco roforo to toots of hypothoofs thot all moons 
for a ofvon dapsndant vorloMa ora oqual ovor tho throa cataoorafs of 
MOiforo statua (AIM, o«norai, no woifaro). 

Ail voiuoo aro uafohtod for nonrosponao bfaa fay aoploy»ant status at 
application and Holforo statua at application and for san^llns 
stratification fay SOA. 

* P^_.C» 
P<_.01 
p<_.001 
**** p<_.0001 
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TAILE 17 

AVEMGES/PERCENTAOES FOR FIVE VARIABLES BY FAMILY STATUS AT APPLICATION 



FMUy Status at l\m of AppUcatfon 



Varfabltt 


Slngla Parant with 
>1 Child undar 6 yrs 


Slngla Parant with 
> 1 Child 7-17 yrs 


Parant In 2 
Parant Nona 


Othar Family 


Non- 
Dapandent 


Avar aot NuriMr of Uaaks 

Uorkad durfng FoUoM-Up 


6.51 


6.53 


8.67 


7.91 


7.59**** 


: 

Ewployiot Rata at 

FoUoM-Up 


^9.09 


50.37 


66.32 


59.72 


57.84 


Avtraot Uttkly incoM 
at FoUow-Up 


187.19 


188.29 


^1.71 


212.71 


187.20**** 


Walfart Status at Follou 
Up Parcantaoaa of Tarni- 
ntat on Ualfara 


49.51 


45.66 


23.82 


13.92 


24.73**** 


Education Status at 
FoUoM-Up Ptrcantaga of 
TarnfnaiM Racai ffng 
Education 


14.53 


10.53 


7.85 


5.S5 


8.70**** 


Rttponsa Rata 


70.19 


74.83 


75.14 


76.32 


65.90 


Saspla Sfza 


681 


878 


1625 


397 


2053 



NOTES: Statistical signlflcanca rafers to tasts of hypothasis that all maans for a givan depen d ent 
variable are equal over categories of fanlly status. 



All values except response rates are weighted for nonresponse bias b/ esployment status 
at application and welfare status at application and for sampling stratification b/ SDA. 

Sample sizes are nmttr drawn In sample, not nusi^er of conpleters. 

* p<_.05 
** p<_.01 
*•* p<_.001 
**** p<_.0001 
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TAtLE 18 

M)JUSTB) mm/^nammE% for five vmiaius iy family status at apipiication 



FMUy Status at Tfnt of AppUcation 



Variibitt 


Sfnoit Rarcnt u/> 1 
Chf Id undar 6yra. 


Sfnglt Rarant wfth 
> 1 ChUd M7 yrt. 


Parant fn 2 
Parant Hoaia 


Othar FaMUy 


Non- 
Dapendant 


Avtraft NuriMr of Uiakt 

Uorkad dirim FoIIom-U|> 


7.1S 


7.36 


7.92 


7.22 


7.75* 


Eii9>(oymnt Rata tt 
FoiloM-UlP 


53.30 


55.66 


61.30 


54.91 


59.20* 


Avtraoa Utakly IrKOw 
at Foliow-Up 


211. a 


209.73 


221.50 


204.64 


195.39** 


Ualfara ftatis at FbUow- 
Up Hrcantagt of Taraf 
natt on Ual fara 


35.70 


33.51 


29.00 


26.85 


27.13* 


Education Status at 
FoUoM-Up Parcantaot of 
Tamfnaaa RacaWfns 

Education 


12.65 


9.24 


8.53 


8.03 


8.68 



NOTES; Statfstfcal sfgnfffcanca rafart to taats of hypothtaU that all means for a gWan dapandent 
varfabla ara aqual ovar catagorfta of fasUy status. 

All valuaa ara uafghtad for nonrasponaa bfas by asployment status at appUcatfon and welfare 
statua at application and for saaplfno stratfffcatfon by SOA. 

* p<_.05 

** p<_.01 

•** p<_.001 

*•** p<^.0001 
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TABLE 19 



AVEMGCS/PCROENTMEt ^(M FIVf VAftlAtlES BY BARRIERS 
TO BMOOCNT AT APftlCATION 



Barrftrt to EiployMnt 



VtriabliB 


Offandar 


Handic^]pad 


llMitad EnaUth 


No Bar r far 


AVBTBiB Muter of UMkB 

UDffcBd durfnt Follow-up 


6.81 


7.07 


9.40 


7.73** 


BmpioyMnt BBtt at 

rolloM-Up 


52.46 


50.87 


62.12 


59.27* 


AvtftfB llMkly Incont 
•t FollowUlp 


199.91 


171.27 


187.88 


209.65** 


Utlfart BtotUB at Follow -Up 
NrcontBit of Toniinoot 
on ytlfort 


37.2U 


22.66 


33.21 


29.39** 


Education Statua at 
FollowUp ^trcantaga of 
Tam'naaa Racaiving 


8.58 


6.17 


34.67 


9.22*** 


Raaponaa Rata 


52.05 


76.36 


69.70 


72.61 


SMpia Size 


438 


330 


33 


4833 



NOTES: StatUtical aignHicanca rafara to taata of hypothaaU that all niaana 
for a oivan dapondant variabla ovar barriara to anployment. 



All valuaa axcapt raapcnaa rataa ara waightad for nonraaponaa biaa by 
atployiiant atatua at applfcatfon and walfara atatut at applfcatfon and 
for aaapling atratif (cation by SOA. 

Sanpla aizaa ara nMber drawn <n 5appla, not nunter of cofiplatars. 

* p<_.05 
** p<_.01 
*♦* p<_.001 
**•* p<^.0001 
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TAILC 20 

ADJUSTED ICANS FOK FIVE VARIAilES lY BARRIERS lO ENPLOTMENT 

iarrfert to Enploywint 



VarfablM 


Offandar 


Nandleappad 


Ifiiftad EnglUh 


No larrUr 


Avtragt Nuter of WMfct 

Uorkwd durfng FoUoM-Up 


7.80 


7.58 


8.15 


7.62 


EiplO)^t Ratt at 
PollOM-Up 


60.25 




46.79 


58.U 


Avtragt Uatkly Incomt 
at FollOM-Ujo 


217,40 


184.42 


155.40 


207.91* 


Utlfart Status at Follow-Up 
Rarcantaga of Tarnfnaaa 
on Ualfara 


31.16 


26.17 


33.03 


29.54 


£ducat)on Status at 
FoUoM-Up Pareantagt of 
Tarnfnaaa RacaWing 
Education 


8.79 


5.00 


27.63 


9.32*** 



MOTES: StatUtfcal sfgnfffcanca rafara to taats of hypothaaU that all means for a given 
dependent varfabla rxe equal over barrfvta to enployeient. 

All values are wefghted for nonreeponee bfas tv aeployeMnt status at application and 
Mel fare status at sppUcation and stratff feat ion fay SOA. 

* P<..05 
** P<..01 
*** p<..001 
p<_.0001 
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TABLE 21 

AVERACCS/rarGENTMES FOR FIVE VARIAilES BY ENPIOYMENT STATUS AT APPLICATION 

EiiV>loyiMnt Status at iSm of AfipUcatfon 



varfablM 


1 

Eaployad 


Unmployad 


Not fn Labor Forca 


Avirata IMrbtr of Waaka 
Uorfcad aurfni FoUoN-up 


10.57 


7.37 


6.32**** 


EiployMnt Rata at 

FolloN-Up 


81.11 


S6.28 


47.62**** 


Avaraga Uaakly IncoaM 
at FolloM-U^ 


199.78 


212.65 


180. 18**** 


Ualfara BUtua at FoUow-U^ 
NfcantaBa of Tanafnaaa 
on Ualfara 


10.23 


30.32 


43. 02**** 


Edicatfon Statua at 
FoUoM-Up Parcantaga of 
Tanalnaaa RacaWfng 
Educatfon 


9.23 


9.03 


9.43 


Raaponsa Nta 


79.46 


70.00 


71 .06 


Saaipia Sfza 




4230 


774 



NOTES: StatUtfcal afgnfficanca rafara to teata of hypothaafa that tha maant for 

tha thraa lavela of aii|>loiyiiient atatua are aqual for aach depandant vartabla. 



AU valuH ara wafghtad for nonraaponaa bfaa by aiiployMnt atatui at 
applicatfon and walfara atatua at appUcatfon and for aanpUng 
atratfffcatfon bf SOA. 

Saapla aUaa ara nuibar drawn fn aanpla, not nmtMr of coaplatara. 

* p*....05 
** p<_.01 
*** p<_.001 
**** p<_.0001 
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TAtLE 22 

ADJUSTED MEANVKKCENTAGE FOR FIVE VARIAtLES »Y EMPLOYMENT STATUS AT APPLICATION 



EiployMnt Statui at Tfat of Aiaplicatfon 



VarfablM 


Enployad 


UhMployad 


Not fn Labor Forca 


Avtraga Nuiter of Uatlcs 
yorktd durfni FoUoN^Up 


9.21 


7.42 


7.56*** 


EnplQiyMnt Utt at 
FoUoM-Up 


6B.64 


57.00 


56.97* 


Avarata Uaakly Incoav 
at FoUoM-U^ 


171.72 


210.76 


212.47** 


Ifalfart Statua at FoUow-U)^ 
Ptrcanta^a of Tanairma 
on Ualfara 


28.20 


29.53 


30.20 


EdJcation Statua at 
FoUoM-Ulp Parcantaga of 
Tanafnata RacaWfng 
Educatfon 


8.55 


9.34 


8.32 



NOTES: StatUtfcal afgnfffcanca rafara to taata of hypothaafa that the Meana for 

tha thraa iavala of aaployMnt atatua a.*t aqual for aach daptndent variable. 

All valuaa are Maightad for nonraaponaa bfaa aaploywent atatus at 
appUcatfon and ualfara atatua at appUcatfon and for aanpUng 
atratfffcatfon by SOA. 

Saapla afzaa ara niMbar drawn In aanple, not ftrnttr of coMpletera. 

* p<_.05 
** p<_.01 
*•* p<_.001 
**** p<_.0001 
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for those with some college. Evidently, college graduates in this 
sample comprise a special group. 

Welfare status at application also has a statistically sig- 
nificant association with all the outcomes in table 15 and with 
all but education status during follow-*up in table 16. Again, two 
anomalies are observed. The adjusted average number of weeks 
worked for those not receiving welfare at application is lower 
than the percentage for AFIDC recipients. Also, the adjusted 
percentage employed at week 13 is lower for nonwelfare recipients 
at application than for kFDC recipients. The bivariate differ- 
ences in table 15 match the expected pattern. 

Effects of family type (table 18) are relatively small, and 
the effects of the barriers (offender, handicapped, LEP) generally 
are small to moderate (table 20). The relatively small effects of 
barriers probably are due in part to the small number of cases 
with barriers to employment. The direct effects of employment 
status at application are small (table 22); however, bivariate 
differences across employment categories (table 21) are 
substantial . 

In addition to the tabulated results, the regression analysis 
revealed that labor market experience has a strong and highly 
statistically significant impact on each of the five outcomes. It 
has a direct impact on weeks worked, the chance of being employed, 
and earnings. It has an inverse eflfect on welfare status and 
school attendance. 

The analyses in this section reveal that most of the controls 
used in prior sections of this report should be implemented if 
valid conclusions regarding SDA impacts are to be drawn. The 
primary class of control variable that has been omitted is local 
labor market conditions — demand factors. Indicators of demand 
such as local unemployment rate and laccr force participation 
rates are potentially important controls. 
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Th« salisnt findings of this study are that JTP Ohio services 
have the intended effects on labor market outcones. classroom 
training and OJT increase employment, increase earnings, and 
reduce the chance of being on welfare. Job search increases 
employment and reduces the likelihood of being on welfare. 

The reason for termination from JTP Ohio training programs is 
a critical mediating factor between services received and the 
labor market outcomes. Those who leave training to enter employ- 
ment are much more likely to be working 13 weeks later, work more 
weeks during tha 13-week follow-up period, earn more during week 
13, and are less likely to be on welfare than those who left for 
other reasons. All the impact of job search on labor market 
outcomes feed through entered employment. A sizable portion of 
direct effects of classroom training and OJT also operates through 
entered employment. 

Differences among SDAs on the labor market outcomes are 
fairly large and highly statistically significant. Controls for 
exogenous background variables reduce these differences substan- 
tially, and added controls for JTP services and reason for termi- 
nation reduce the differences still further. Yet, after all 
controls are included, highly statistically significant differ- 
ences remain among SDAs. 

Further discussior^ of these results is provided in the con- 
cluding chapter. 
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CHAPTER 4 



DISCUSSION AND RECOMMENDATIONS 

The data analyzed here show the expected relationships 
between predetermined variables such as education, labor market 
experience, race, age, and gender and the five outcomes examined 
In this report—weeks worked during the 13 -week follow-up period, 
employment status In week 13, earnings In week 13 of those who 
were employed, welfare status In week 13, and school attendance 
during the 13-week period. The most Interesting findings, how- 
ever, are that JTP services have the Intended effects, and entered 
employment Is & pivotal Intermediary between JTP services and the 
outcomes. The total effects of classroom training, job search, 
and OJT on employment In week 13 and weeks worked are strong and 
positive. The effects on receiving public assistance are strong 
and negative. Additionally, classroom training and OJT Increase 
earnings. 

Addition of control for the reason for termination substan- 
tially reduces all these effects and reduces job search effects on 
all outcomes except education status to near zero. Reason for 
termination has a strong Impact on all the outcomes. Our findings 
agree roughly with those of Hollenbeck and Bennicl (1987). Job 
search helps one find a job but does not Improve earnings. 

The encouraging aspects of these findings Is that factors 
directly under control of public policy and administration do 
Influence economic and social outcomes. In one sense, classroom 
training appears to be a particularly useful tool because It tends 
to serve those with a lower socioeconomic profile than does OJT. 

A potentially useful quantitative model to assist In evalua- 
ting SDA performance was sketched In this report (see figure 2 and 
table 12) . The basic Idea Is to observe the deviation of the 
adjusted mean on each outcome for each SDA from the corresponding 
state average. The adjusted means compensate for differences 
among SDAs In the socioeconomic composition of the clients they 
serve (see column two of table 12) . It Is possible that statisti- 
cal tests of whether these adjusted means differ from the state 
means could be used In the evaluations. For example. Incentive 
grants could be provided to SDAs who perform above a state stan- 
dard to a statistically significant degree. The sole criterion 
should not be statistical slgnlf Icancy, however, because statisti- 
cal significance depends so heavily on sample size. 

Although the analyses reported here did not support the view 
that effectiveness of JTP services varies among SDAs, tests for 
the possibility of such variations should probably still be 
Included In future research and evaluation. An additive regres- 
sion analysis Implies that any differences among SDAs on the 
outcome variables are due solely to the quantity of services 
provided. Take classroom training as an example and specify an 
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lnt«raction tmrm to capture th« notion that classroom training in 
soas SDAs is Mors sffsctivs than it is in other SDAs. 



Yij ■ a + bj + c'CIASRij + dj'CIASRij 



-i- Sij 



whsrs 



' Yij ■ outco«s such as samings for individual i in SDA j, 
a - intsrcspt constant, 
bj - additivs sffect of SDA 
c - additivs sffsct of classroom training, 
dj - interaction coaponsnt of classrocn and SDA sffects, 
CIASR - classroom training (msasursd as yes, no or as a 

quantity) , 
eij - random disturbance* 

It is seen from this specification that the effects of classroom 
training are 

classroom effects «■ c -f d j • 

Since j indexes SDAs, the effects differ in different SDAs. 

It is worth noting that one potentially important advantage 
of evaluating SDA performance with individual-level data is that 
the added detail of individual information allows one to separate 
quantity and quality effects. Averaging both sides of the above 
specification yields 



yj ■ a + bj + (c + dj)CLASRj + ej* 

This equation could not be estimated with only SDA averages 
because it contains more parameters (a, b j , c, dj) than there are 
observations. 

An important aspect of the analysis conducted here is that no 
one is included in the sample who had not participated in JTP in 
some fashion. Lack of a comparison group makes it impossible to 
assess the overall effects of participation. Absence of a com- 
parison group also means that SDA evaluations necessarily depend 
on comparisons among JTP clients in different SDAs. A type of 
"grading on the curve" therefore is implied. With a comparison 
group it would at least be feasible to attempt to establish evalu- 
ation criteria based on the extent to which JTP clients fare 
better than nonclionts rather than criteria based solely on 
whether clients in one SDA do better than clients in other SDAs. 

Implementing the strategy sketched here would require careful 
study, however, to avoid both the reality and the appearance of 
being xinfair to some SDAs (e.g., Youngstown) . At minimum, local 
Inbor market indicators of demand should be added to the regres- 
sion equations. 
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Additionally, it would be advisable to draw on several 
experts on training, methodology, and evaluation to help formulate 
appropriate procedures. An unusual opportunity to integrate 
theory and practice is apparent here. Our evidence strongly 
supports academic findings that education and labor market experi- 
ence are critical determinants of the labor-market outcomes. In 
developing an evaluation strategy, it would be desirable to fur- 
ther draw on the best available knowledge. It appears useful to 
hold a conference to examine critical issues such as these: 

o What outcome variables would best capture the im- 
pacts of JTP programs? 

o What control variables would best adjust for differ- 
ences among clients served by different SDAs? 

o What sampling strategy is optimum, given resource 
constraints? 

o What statistical models/analyses should be con- 
ducted? 

o How should the evaluation involve SDA leaders to 
assure their cooperation? 

o How can qualitative data based on direct observation 
best be incorporated into the analysis? 

o How can quantity and quality of services be 

separated in the statistical analysis (See sugges- 
tion above) 

o What local labor market indicators of demand and 
demographic composition variables should be 
included? 

The preliminary analyses reported here indicate that a first-rate 
evaluation is feasible. A large and growing literature on evalua- 
tion of training programs is available (see, e.g., Stromsdorfer 
1987 for a recent review) . This literature should be combined 
with practical experience to develop an evaluation model. 
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